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Information Theoretic Models of Human-Machine Interaction 


ABSTRACT 

Current advances in computing technology are devoid of formal methods that describe 
the theories of how information is shared between the humans and machines. Specifically, in 
the domain of human-machine interaction, a common mathematical foundation is lacking. The 
aim of this paper is to propose a formal method of human-machine (H-M) interaction paradigm 
from information view point. The methods presented are interpretation - and context - free and 
can be used both in experimental analysis as well as in modeling problems. 

1. INTRODUCTION 

The effectiveness of modem information technology depends in parts on the level of 
human-machine interaction. The human users of information systems (softwares) are faced with 
information state space which are complex. This complexity evolves around both human 
behavior and the machine state dynamics (see, e.g; [2,7]). Unfortunately, as many studies 
[11,14] indicate, the level of information loading continue to be the number one problem 
affecting the design of softwares. One reason to this problem is that software engineers and 
information scientists seem to ignore the formal approach to the design of H-M interface in the 
software development life cycle. 

Suffice to say that even in a simple human-computer system environment, the issue of 
developing a formal method (mathematical theory) of interface paradigm still remains an enigma 
(see, e.g; [1,5,6]). Rasmussen [14] supports this view by observing that "in human-machine 
interaction, it appears to be necessary to consider the same distinction between signals and signs 
for the significance of human acts as it is for the information observed by a human. This 
dynamic interaction with the environment of complex behaviors calls for a very efficient feature 


extraction and classification and dynamic coordination of the human-machine system with the 
task environment. 

Most existing formal methods of H-M interaction are context specific and concentrate 
more on: 

(a) the allocation of tasks to human operators and machines [1,5,10,19]; 

(b) display design and information presentation theories [1]; 

(c) communication bandwidth and dialogue protocols [13,15]; 

(d) group behavior theory [4,18]; 

(e) matching human behavior maps to information load [13,17], 

The citations above have a common drawback in that no general method of H-M 
interaction exists. What is often described is the engineering process of H-M interaction which 
lacks the rigorous scientific theories. Methodologically, information theory is needed to 
characterize the H-M interaction environment. This problem is presented here in a context - and 
interpretation free format. The discussions are based on elementary functions of automaton. 

2. PRELIMINARIES 

The human-machine interaction (HMI) problem can be stated succinctly as follows: given 
a computer system C, and the human (as a controller, supervisor, user, etc.) H, we are 
interested in the design d; such that 

d = <p H A <p c b 

and D = <p H U <P C 


We use D to be the universe of design discourse; d to typify the interaction domain such d e D; 


<t> H and <£ c are the feature space characterizing the human and computer systems respectively. 
When the word "model" is used, we shall mean the elements of the computer system. Thus, 
<£ c is a model feature space whereas <t> H is a physical feature space. We also define the general 
feature space 4> by the three element grammar defined by 

<fi = { I,X, P } 

where I is the information vector characterized by the four tupple 

I = { S , M, U, V } 

with S as the information source (or sensory matrix); M the information modality which assigns 
"type" (logical, numerical, etc.) to the value of the information; U is the information control 
vector that triggers information occurrence; and V is a matrix of input-output data defined by 

V\ = <T' ® 1° ) 

f is the input data usually from the physical source (user-input) and 1° is the output data, usually 
from the model source (computer system). The operator ”<8>" is defined as concatenation, 
operator, e.g; {a} <8> {b} = (ab}X defines the global state of the H-M system and is defined 
by 

X : = <T 0 E > 

where T is the task vector and E is a environment disturbance. P is a performance matrix 
defined by column-wise concatenation operator || over the tupple elements defined by 

ps 4IM|0> 


where S is a Mealey automaton state- transition function [13] defined by 



. . . S : X x Vj-+ J 1 

U is a Mealey automaton output function defined by 

a?: \ x v 2 -* 1° 

(3 is a combination network on 5 and co defined by 

0 : 5 x w -*• 0 


ldT\ 

dV ' 


dl° 

ldT\ 

dV ' 

\3v) 

dr 


Note that £T uniquely defines the differential change in the task information with respect to 
3V 


input-output matrix V. For a example, in a supervisory control task, this differential may be 
a change in the domain of diagnostic problem solving such as reading pressure or temperature 
gauges, dv/df is the qualitative change in output data assuming no new input data 
3. FORMAL DESCRIPTION 

The HMI system is described by the following sets: 

Terminal- state function 


; Y i = a d ( I, P, Z ) 

where a d is a translation function mapping the features <f) H and <f> c in feature space d e D. a D is 
a many-to-many corresponding mapping with P as the evaluation function. 

z = { z ir 0 , } 


where is the physical task vector defined by 
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Z x \ = co ( I, A ) 

Zj is the model for information combination defined by 

DEFINITION. The interaction is said to be "symbiotic" optimal if 

{ id e <p c j 3 he <p H ] (p h A 0^ = 

The algebraic relation is that for every model feature 6 e <£ c , the human can interact successfully 
to perform a defined task. The concept of symbiosis is to measure the level of cooperation 
between the physical and model elements. This relation can be proved easily by invoking the 
laws of absorption which argues that if 4> ( £ <t> h , then <f> £ A <f> b = <f> £ , where A is a 
conjunction operator. 

DEFINITION. The performance matrix is a linear manifold structure of Z. This property is 
a fundamental approach to information aggregation. Note that Z = (Z 1; Z 2 ) represents 
information structure associated with the physical (human) and the model (computer) elements. 
If the event, say h e H occurs with observation error e^ and the event say 6’e C occurs with 
model error e*. By definition, Z = { Z x -* Z x + 0, Z 2 -*Z^ + ej. 

Since the systems is considered to be dynamic, this allows us to write, Z as a time dependent 
system of control automatioh: 

Z = A Z + E 
P = G Z 

where A is the matrix derived by 8 || u || 0, E is the error matrix derived by concatenation of 
e,, and e^, and G is a constant performance matrix. Note however that A and G are chosen to 
be semi-positive definitive and the values of Z are obtained via real time observation. An 


example is the human pilot interacting with the pilot associate program in deciding on where to 
land an aircraft during a severe storm. 

DEFINITION. Let 0 be an Euclidian information space. Consider a subspace <f>, such that 
0, A 0 = 0. Then 0 can be represented in the form 

0 = <p(z) +N 

where z e 0„ <p( z) e 0, and N is orthogonal to <p( z). The property of 0 is such that 
E { 0(z) + N } = E { 0 -0(z) ) • 0 (z)} = 0 

Further, the distance between 0 and any point p in y?( z) satisfies 

E {(0-p) 2 } > E {(<p-<p[z) ) • 0 >(z)} = 0. 

with the equality if p = y?(z); 0 (z) is known as the projection of 0 on 0 ,. This definition 
stipulates the relationship between the human observer trying to project his or her corporal self 
into the domain of a model state space. An example of <p( z) is a pilot undergoing a flight 
handling simulation exercise and 0, is the model information characterizing the aircraft 
dynamics. The orthogonal vector N may represent the actual observation data during the 
experiment. 

DEFINITION Let r(D) be a measure of H-M interaction design effectiveness. Then we define 

r(D) = — °} 

Max {0 f , 0 A } 

PROPOSITION. Let r(0 c ) and r(0J represent the design effectiveness of model and human 
elements, then r(0 c A 0J < r (0 C ) + r(0h) 

Proof. The result above follows the triangle law of inequality and the law of conjunction 


operator. 



DEFINITION. Let m(D) be a measure of H-M interaction design efficiency. Then we define 


m(D) 


u(I h , X„) 


Max {Z, , Z 2 j r for all h e H 
Note that efficiency is used here to measure the human elements that have been tested and 
validated for the system. 

DEFINITION. Let s(D) be a measure of interaction "symbiosis" between H and C. Then s(D) 
is related to r(D) and m(D) by s(D) = r(D)/m (D); s(D) ^ 0 and m (D) ^ 0. 

Note that if s(D) = 0 then r(D) = 0 implies that 4> c A <f> h = 0. 

DEFINITION. Let a D be an information mapping function on the universe of design discourse 
D such that the probability A (D) exists. A (D) follows the usual definition of probability 
axioms, such that 

Y = 1 * 

d t D 


We can therefore define the mapping function a D (0 c , 0 J by the relation 

= min{A(0 A ) , A (0 C ) , A(^A^)} 

DEFINITION. Assume that information value can be measured on some distance metric n(4>). 
Further, assume the existence of optimal policy 

0* e <p h A <p c V h e H ; Vc e C. 

Define the design error e d by e d = 0 h - 4> c . e d can be written in terms of 0’ by 

e d = (0 h + 0*) - (0 C - 0‘). If there are d design variables observed in 0; then the d - norm 

error distance n(0) is defined by 


n(0) = ||d|| 


that is 


t : 


! 


| 


. . _n(0) = [(<P h + *')“ + (0’-0 e ) T 

PROPOSITION. If 4>* - 0 C = 0, then the distance measure n(<f>) is said to be regular with 
respect to the human observer. In this case, the human is said to "gain" all the information in 

0c 

Proof. If 0* - 0 C = 0; then 0* = 0 C . By definition, 0’ = 0 h A 0 C 

that is 0 C = 0 h A 0 C . By rules of Boolean algebra; 0 C Q 0 h ; and 0 = 0 h is the universal set. 
Therefore 0 A 0 C = 0 e . Hence, n(0) = {(<^ + 0*) d } 1/d = 0 h + 0*; this implies that 0* = <j> c 
is the gain. An example of this proposition is used in developing decision support systems. 
Here, 0 h is what the person using the system had known already, 0* = 0 C is the decision support 
information from the computer which is new to the human. If at the end of interaction, the 
human has learned all 0 C , by the proposition, information gain has taken place. 
PROPOSITION. Let H, be experimental or observation matrix which is a positive definite. 
Then H, = 0 h . <j>\ 

Proof. Let the matrix function H,: R ® J -* R be induced in the natural way by multiplying the 
design matrix R by a unit matrix J. R is defined such that 
R ® J: = < 0 h , 4 > c , J > , V h e H, V c e C with the definitions: 

0h : = 0h • Jh -* 0h 

0c : = 0c ® Jc 0h 

I: = J h | J c , when " || " means column wise concatenation. Without loss of meaning. Let us 
assume the relationship: J h and J c to be unit matrices defined on 4^ and 0 C respectively. 

0* * 0 e * 0c’ = <fh (0* * J h 0c J c) 0cW J h 


i n 


i 


The left hand side of equation is equal to 0 h • J c . And the right hand side is simplified to 


J h • (ft. • H x • . Thus, 4> b -J c = J h 4>i Hj J h 

If we post concatenate J h on both the left and right hand side of the equation above, we have 

4 > h * J = Jh 4>c H i J 

^ Hi 

Hence H, = [(p h 'J~ h l )<p~ c l 



H, = <t> h -<t>~c (since J b = J„) 

Note that the model information matrix has become a weighted matrix for the observation 
matrix. We assume that <f> b and 4> c have the same cardinality. 

4. CONCLUSIONS 

The development of information theoretic models based on abstraction and automaton 
theory, provides a framework for measuring the effectiveness and efficiency of human- machine 
interaction design. In addition, a general framework for formal methods of modeling H-M 
interaction is suggested. 

As a prolegomenous discussion, the basic definitions and some propositions with proofs 
are presented. Specifically, the formal descriptions rely more on abstractions and equivalence 
formulations of formal method rather than inductive hypothesis. The presentation is open-ended 
in format. Thus, the concept presentation are useful in disciplines such as software engineering, 
fuzzy models, and decision support system (expert system) techniques. 
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